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Abstract: Linear structural error-in-variables models with univariate ob- 
servations are revisited for studying modified least squares estimators of 
the slope and intercept. New marginal central limit theorems (CLT's) are 
established for these estimators, assuming the existence of four moments 
for the measurement errors and that the explanatory variables are in the 
domain of attraction of the normal law. The latter condition for the ex- 
planatory variables is used the first time, and is so far the most general in 
this context. It is also optimal, or nearly optimal, for our CLT's. Moreover, 
due to the obtained CLT's being in Studentized and self-normalized forms 
to begin with, they are a priori nearly, or completely, data-based, and free 
of unknown parameters of the joint distribution of the error and explana- 
tory variables. Consequently, they lead to a variety of readily available, or 
easily derivable, large-sample approximate confidence intervals (CPs) for 
the slope and intercept. In contrast, in related CLT's in the literature so 
far, the variances of the limiting normal distributions, in general, are com- 
plicated and depend on various, typically unknown, moments of the error 
and explanatory variables. Thus, the corresponding CPs for the slope and 
intercept in the literature, unlike those of the present paper, are available 
only under some additional model assumptions. 
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1. Introduction 

In the linear error-in-variables model (EIVM) of this paper we observe pairs 
{UiiXi) e according to 

Vi = I3£.i + a + Si, x^^Ci+£i, (1) 

where are unknown explanatory /latent variables, the real- valued slope /3 and 
intercept a are to be estimated, and Si and are unknown measurement error 
terms/ variables, 1 < i < n, n G TN. EIVM ([1]) is also known as a measurement 
error model, or structural/functional relationship, or regression with errors in 
variables. It is a generalization of the simple linear regression of form yi = 
-\- a + 5i in that in ^ it is also assumed that the two variables r] := -I- a 
and ^ are linearly related, and now not only ry, but also ^, are observed with 
respective measurement errors 5i and e^. 

In this paper we deal with the so-called structural EIVM (SEIVM), the model 
where the explanatory variables are assumed to be independent identically 
distributed (i.i.d.) random variables (r.v.'s) that are independent of the error 
terms (cf. (C) below). The case of ([T]) with a known to be zero is distinguished 
in the literature as the model without intercept. Convenient notations that are 
introduced in this paper (cf. (O, ([6])) allow us to study both the no- intercept 
model and the model with unknown a simultaneously. 

All our assumptions about ^ are summarized next: 

(A) {((5, e), {Si^Ei), z > 1} is a sequence of i.i.d. random vectors with mean 
zero, E 6"^ < oo and E e'^ < oo, and with a positive definite covariance 
matrix 

r = Cov(<5,£)=(^^^^2), (2) 

(B) {^, ^i, i > 1} are i.i.d. r.v.'s in the domain of attraction of the normal law 
(DAN), i.e., there are constants a„ and &„, 6n > 0, for which {J27=i " ^n) 

^ N{0, 1), as n — > cxD, 

(C) ((5, e) and ^ are independent. 

Remark 1. Further to the definition of DAN in (B), it is known that a„ can 
be taken as nE and &„ = n^^'^i^{n), where i(^{n) is a slowly varying function 
at infinity (i.e., £^{az)/£^{z) — > 1, as z ^ oo, for any a > 0), defined by the 
distribution of Moreover, £({n) = -^Var^ > 0, if Var^ < oo, and £{(n) y oo, 
as n ^ oo, if Var^ — oo. Also, ^ has moments of all orders less than 2, and the 
variance of ^ is positive, but need not be finite. 
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Apart from making assmnptions on the distribution of {^,6,e), to ensure 
identifiability of unknown parameters such as, for example, /? and a in model 
([1]), it is common in the literature to make use of some side conditions in this 
regard, usually as conditions on the matrix F of ([2]) in (A). There are only a 
few frequently used identifiability assumptions, and here we deal with two of 
them that read as follows: 

YsLT 6 = X6 and cov((5, e) = fi are known, while Vare=0 is unknown; (3) 

Vare — 9 and cov((5, e) — fi are known, while Var(5=A0 is unknown. (4) 

The identifiability assumption (|4]) is likely to be realistic in many applica- 
tions. Neither ([3]) nor ([4]) correspond to orthogonal regression estimation in JT]) 
that requires the assumption that the ratio Var S /Var e = A is known and that 
cov((5,e) = (cf. Carroll and Ruppert ([TM51) . Carroll et at. pTOS)) . Cheng and 
Van Ness (|1999p . Fuller ri 987p for some further discussions along these lines). 

For further use throughout, for real-valued variables {ui, 1 < i < n} and 
{vi, 1 < i < n}, we put 



n 1 

u^-}Ui, Siuv = {ui- cu){vi- cv) and Suv = — } Si.^v, (5) 
with constant 

, if intercept a is known to be zero, 

1 , if intercept a is unknown. ^ ' 

Under ([3]), the modified least squares estimators for /? and a (cf. Cheng and 
Tsai (|1995p ) that have been used when it is assumed that < Vari^ < cxd are 

Pin = _ — and ai„ = y-x Pin, if S^y-fJ. 7^ and Syy-X9 > 0, (7) 

while those under ^ are 
S 

(32n = ^ and a2„ = y-x/32n, ii Sxx - 9 > 0- (8) 

^xx " 

We note that the estimators in ([7]) and ([8]) coincide in form with the respective 
maximum likelihood estimators for (3 and a that are derived and studied in the 
model ([1]) under the assumption that vector (^,(5, e) is normally distributed. 

In this paper, we revisit the estimators in ([7]) and ([5]), and prove several 
central limit theorems (CLT's) for each of them (cf. Theorems [TH31 and Corol- 
lary [T]), under the distribution-free DAN assumption in (B) on the explanatory 
variables that, to the best of our knowledge, is the most general ever used so 
far in this context (cf. Remark [2]). Moreover, according to Theorem [1] it is also 
optimal for the CLT's therein, and is nearly optimal for the CLT's in Theorems 
[5] and [3] (cf. Remark [3]). As to the condition (A) on the error terms here, it 
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seems to be the least restrictive that has been considered in the hterature thus 
far. 

Further to the special features of our CLT's in Theorems [T]-[3l all these CLT's 
are in Studcntized or self-normalized forms to begin with and hence are auto- 
matically nearly, or completely, data-based. Namely, as compared to the CLT's 
for P and a in the literature, Theorems [iHl] are a priori free of any unknown 
parameters of the distribution of {£,,6,e) (cf. Remarks |31 H]) , and, consequently, 
the corresponding large-sample approximate confidence intervals for the slope /3 
and intercept a are readily available, or easily derivable as in our main Theorem 
m (cf. the corresponding subsection right below Remark [8] for details). 

Throughout Section [21 we pay a special attention to the SEIVM's ^ when 
Var^ = oo (as allowed by (B) in view of Remark[T]). Distinctive features of such 
models are obtained in Remarks [5]-[7] (cf. also Remark [5]) that are seen to under- 
pin our informal observation: the impact of the errors with finite variances in Xi 
of ^ becomes automatically negligible as compared to that of the explanatory 
variables with Var^ = oo, and such SEIVM's are then close in spirit to, and 
behave like, the simple linear regression models yi = (3xi -\- a -\- 5i. 

All the CLT's of this paper have strongly been inspired and influenced by 
recent advances in DAN via Studentization and self-normalization that are 
summarized in Csorgo, Szyszkowicz and Wang (|2004p . These developments 
prompted us to enrich the traditional two-moment space of the explanatory 
variables that has been used so far for CLT studies in SEIVM's ^ by allowing 

the first time to be simply in DAN with possibly infinite variance. For the use 
of DAN in some other regression models, we refer to Mailer (|198ip and Remark 
(iv) in Mailer (fT993l) . 



2. Main results 



We establish Studentized and self- normalized CLT's for each of the estimators 
in dZl) and (g]) in Theorems [T]-[3l and, together with the CLT's of Corollary [T] 
and the confidence intervals of Theorem [H they constitute the main results of 
this paper. 

Theorem 1. Assume that the intercept a in ^ is known to he zero, {■f,^!, i > 
1} are i.i.d.r.v.'s, E\^\ < oo, and (A) and (C) hold true. Put 

TKn „A -J-^^y ' = 1' „ f-i n\ -/ " >^0)-PiSt,xy- , if j = 1, 

(9) 

Then for j — 1 and 2, (B) is equivalent to any one of the following CLT's; as 
n — > oo, 



(a) V^Uij,n)0jn - P){EtiiMj.n) ~ w(j,n) )V(n - 1)) ^ iV(0, 1), 

(b) nt/(j,n)(^,„-/3)(Er=i«fa«)) ^NiO,l). 
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Theorem 2. Assume (A)-(C). Let 

Then, for j = 1 and 2, the CLT's in the (a) and (b) parts of Theorem [T] hold 
true, and also, 

/ n \ -1/2 

nU{3,Ti){%^-l5)\^u\{3,Ti)\ ^iV(0,l), 71^00. (11) 

Theorem 3. Assume (A)— (C). For j — 1 and 2, tet 



'>^i{.h n) = {Vi - a)- l3jnXr - —. — r u^{j, n), 



(12) 



where U{j,n), Ui{j,n) and Ui(j,n) are as in ^ and (jlOp . Then, for j — 1 and 
2, as n ^ 00, 

(a) (a,„ - a) ( J:tli^^ i.h n) - Hj^)V{n - 1)) ^ Ar(0, 1), 

(b) V^(a,„ - a)[j:tiiMj,n)-Wn))yin 1))"''" ^ 7V(0, 1). 

Remark 2. It follows from Cheng and Tsai (I1995P that, under (A), < 
Var^ < 00, (C), independence of S and e, and E < 00, /3j„ and cijn are -^/ri- 
asymptotically normal, for j — 1 and 2. In Theorem 1.2.1 of Fuller (jT987|, among 
other things, the same conclusion is derived for and a2n under the condition 
that (^, S, e) is normally distributed with a positive definite diagonal covariance 
matrix. While Theorems [lH3] seem to present the first CLT's for SEIVM's ^ if 
Var^ = 00 (as allowed by (B) in view of Remark [1]), they also imply the just 
mentioned CLT's for /3j„ and aj„ when Vari^ < 00. Indeed, under the conditions 
of the specified CLT's in the literature, using the arguments from the proof of 
upcoming Corollary [U expressions U~'^{j,n)J2^=i{ui{j,n) — u{j,n) )^/(n — 1) 

and X]r=i(''^jO' )^/("'^l) from the respective (a) parts of Theorems[I] 
and [31 j = 1,3, can be seen to converge in probability to positive constants that 
are the variances of the asymptotic normal distributions of the corresponding 
estimators obtained in Cheng and Tsai p995p and Fuller p987p . 

Remark 3. Due to their Studentized and self-normalized forms, the CLT's of 
Theorems [TH3] are invariant with respect to the distribution of (^, 5, e) satisfying 
(A)— (C), and are strikingly free of any unknown parameters of this distribu- 
tion (depend only on the error moments that are assumed to be known in the 
identifiability assumptions ^ or (jl])). In addition, (fTTI) of Theorem [2] and the 
(b) part of Theorem [3] present completely data-based CLT's, while (3 is the only 
unknown parameter appearing in the respective normalizers (X]r=i ~ 



Yu. V. Martsynyuk/ChT's in error-in-variables models 



200 



n) ) V(n- (J^^^ u,U, n)2) -^/^ and (ELiKO', ") " ^U^ ) V("- 

1))^^/^ of the CLT's of Theorem [T] that, according to Theorem[21 also holds true 
for the case of unknown a, as well as of the CLT's of the (a) part of Theorem 
[3l Consequently, large-sample approximate confidence intervals for (3 and a are 
readily available from (fTTjl of Theorem [2] and the (b) part of Theorem [3l while 
those that follow from (a) and (b) of Theorem [T] are easily derivable. For the 
expressions for, and further discussions on, all these confidence intervals, we 
refer to the corresponding subsection, right below Remark [51 We also note that 
while (B) is optimal for the CLT's of Theorem[l]in the case of the no-intercept 
version of model ([T]), this condition is also optimal for the model ^ with an 
unknown intercept for the main terms in the expansions for the Studentized and 
self- normalized (3jn and Sj„ as in the CLT's of Theorems [2] and [3] (cf. respective 
proofs of Theorems and [31 proof of Lemma [51 and conclusion of Lemma [7]) . 

Remark 4. On account of their a priori Studentized and self-normalized forms, 
and also due to their respective features described in Remark [3l the CLT's of 
Theorem [iHSl appear to be also new when Var^ < oo (a special case of (B) in 
view of Remark[T]) . Indeed, as opposed to Theorems[TH3l in the CLT's for (3jn and 
cijn in Cheng and Tsai (|1995p . j = I and 2, that are proved under Var ^ < oo (cf. 
Remark[2lfor details), the expressions for the variances of the asymptotic normal 
distributions of (3jn and cijn are complicated and involve typically unknown, 
hard-to-estimate from data, moments of order < 4 of the error terms, in addition 
to the unknown parameters f3, and Var^. Then, in order to be able to 
estimate the variances of the therein derived CLT's, it is additionally assumed 
that the errors S and e are normally distributed. Consequently, the variances 
of the latter CLT's become simpler in form and contain only the unknown, 
but estimable /9, E^, Var^ and X9 (or 9). To handle similar difficulties with 
estimating the respective asymptotic variances of P2n and a2n in Theorem 1.2.1 
of Fuller (|1987p . the condition that (^, S, e) is normally distributed and has a 
positive definite diagonal covariance matrix is used. Consistent estimators for 
the respective asymptotic variances of (3jn and cijn that are proposed in the 
mentioned works are different from the expressions U~'^{j,n)^^^^u1{j,n)/n 
and ^^^i{vi{i,n) ~'v{j,n) )^/(n— 1), respectively taken from Theorems [21 and 
[3l When Var^ < oo, due to (IST]) with ■qi{n) = Ui{j,n) and rii{n) — u-(j, n), ([55]), 
([58]) . ([eO]) . ([6T]) . ([64]) . ([68]) and jM]), the latter expressions appear to be the first 
consistent estimators for the just mentioned variances simply under (A). 

In Theorems [THSl the rates of convergence to normality of /3j„ and cijn are 
not apparent. For the sake of explicitly displaying these rates, we introduce the 
following direct consequence of Theorems [IHSl 

Corollary 1. // (A)— (C) are satisfied, then for j = 1 and 2, \/n£^{n)((3jn — 

P) N{0, Cj) and ^/n{ajn—a) N{0, dj), asn ^ oo, where £^{n) is a typically 
unknown slowly varying function at infinity as in Remark]^ that converges to 
infinity when Var^ = oo, and equals to a positive constant when Var^ < oo, 
while Cj and dj are positive constants. 
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Remark 5. From Corollary [l] /3j„ are seen to be ^/n^^ (n)-asymptotically nor- 
mal estimators of /3. In this regard we note that when Var^ = oo, the degree 
of precision of (Jjn increases as compared to the case Var^ < oo. This effect 
rhymes well with our empirical expectation in that, intuitively, by letting in 
(fTj) to have an infinite deviation, we make them more dominant over the errors 
with finite variances. This, in turn, renders observations iji and Xi to be more 
robust to noise (errors) and thus, more precise. As to the estimators Sjm accord- 
ing to Corollary [H they are -^/n— asymptotically normal, regardless of whether 
Var^ = oo, or Var^ < oo. 

Remark 6. We observe that if Var^ — oo, then ([3]) and (jl]), as well as any other 
identifiability conditions, are unnecessary for constructing consistent estimators 
for (3 and a. For example, using similar arguments to those in ([SU)) and (pT|) . it 
can be shown that Syy/Sxy and Sxy/Sxx are consistent estimators for j3. The 
existence of these consistent estimators implies that (3 is identifiable. The latter 
fact, when (5, e) has a normal distribution, can also be concluded from Reiers0l 
P950p . as accordingly, /3 is identifiable if and only if ^ is not normally distributed. 
As to consistent estimators for a under Var^ — oo, one has y — x Syy/Sxy and 
y ^ Sxy/Sxx- 

Remark 7. Condition Var^ = oo can also be related to one of the frequently 
used identifiability assumptions for SEIVM's llj that reads as follows: 

reliability ratio k, := _ ^^j^^y ^ ^ is known, ^^3^ 
under Var^ < 00 and E{de) = 0, 

where c is as in ([6]) . In the case of Var ^ < 00, the coefficient plays a key role in 
the large sample theory of regression with errors in variables ([T]). In particular, 
k^ adjusts the ordinary least squares estimator Sxy/Sxx of the simple linear 
regression yi = (3xi -\- a + 5i for consistency in llJ (that holds under (A) with 
/z = in ([2), (C) and < Var^ < 00) as follows: k'^^Sxy/Sxx- Now, defining 

k^ of ([131) to be 1 if Var^ — 00, we have k^ ^Sxy/Sxx — Sxy/Sxx^ where the 
latter expression is one of the two proposed estimators for /3 under Var ^ = 00 
in Remark [6] that, in turn, coincides with the ordinary least squares estimator 
and does not require an adjustment via k^ in ([1]) any more. The following view 
of the SEIVM ([T]) under Var ^ = 00 may shed light on this phenomenon. In Xi of 
(m , the impact of the error terms with finite variances is negligible as compared 
to that of the explanatory variables with Var^ = 00, and the model becomes 
close in spirit to, and behaves like, the simple linear regression yi = (3xi -\-a + 5i. 
We also note that if Var^ < 00, then the reliability ratio fc^ usually has to 
be estimated from prior information for the sake of further use in inference in 
EIVM's. However, under Var^ — 00, no estimation of fc^ := 1 is necessary. 

Remark 8. The present paper constitutes a part of Martsynyuk (|2004p . where, 
among other things, in the same context and spirit, the author studies weak/strong 
consistency and asymptotic normality of least squares estimators for the slope 
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and intercept, as well as of methods of moments estimators for the error vari- 
ances, under ^ and (g]), and yet another identifiability condition that assumes 
that the matrix F of ([2]) is known at least up to an unknown multiple = Vare. 
As to the problem of proving new similarly featured CLT's for estimating a) 
under the same model assumptions as those used in Theorem [THSl namely un- 
der (A)-(C), we again refer to Martsynyuk p004|) . The author's Ph.D. thesis 
Martsynyuk (2005), among other things, also extends the just mentioned con- 
tributions of Martsynyuk (|2004p regarding the SEIVM's to their traditional 
companions, the functional EIVM's H]), where the explanatory variables are 
assumed to be deterministic. 



Confidence intervals for slope f3 and intercept ct 



Abbreviations LSA and CI stand respectively for large-sample approximate and 
confidence interval, while denotes the 100(1 — 7/2)'^ percentile of the stan- 
dard normal distribution, < 7 < 1. 

In the SEIVM's ^ studied under (O or (U), LSA CPs seem to be the only 
source of CPs for the slope (3 and intercept a. In order to work out completely 
data-based LSA CPs for f3 and a from the corresponding CLT's in the literature, 
additional conditions of normality for the errors alone, or together with those 
on the explanatory variables have been used (cf. Remark [5]). In contrast, on 
account of Theorems [IHSl computable LSA CPs for (3 and a are now available 
under the very general distribution-free assumptions in (A)-(C) (cf. Remark 
[3]), and also the first time under Var^ = 00, as a special case of (B). Thus, 
for J = 1 and 2, completely data-based CLT's of (fTTj) of Theorem [2] and (b) 
of Theorem [3] imply readily available respective LSA 1 — 7 CPs for /3 and a, 
< 7 < 1, as follows: 



1/2 



Pjn T Zj/2 777— \ ' (14) 

' nU(j,n) 

, - ^, • (15) 

^/n{n - 1) 

Moreover, under the usual assumption that Var^ < 00, (fT4|) and (fT5|) are also 
new, being different from the aforementioned LSA CPs in the literature (cf. 
Remark IH). 

Under each of the identifiability assumptions ([3]) and ([4]), in addition to the CI 
of (HH), another two new LSA CPs for /? are also within reach. Namely, these are 
the LSA CPs for (3 from the Studentized and self-normalized CLT's in (a) and 
(b) of Theorem[T]that, according to Theorem[2l also hold true for the SEIVM JT]) 

with an unknown intercept a. In these CLT's, f3 is left uncstimated in the nor- 

/ ^ \-i/2 / \-i/2 

malizers T,'i=iiutU^ - "(j- f/ (n - l)j and J2i=i "?(j' 

respectively, j — I and 2, as opposed to the corresponding CLT's of (fTTj) of 
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Theorem [2] that are used to obtain (fT4|) . In TheoremlH we obtain such CI's only 
under the identifiabihty assumption ([3]) (case j — 1). The case when that of ^ 
is being assumed can be handled similarly. 

Theorem 4. Assume (A) and (C) and that E\S^\^/^ < oo, which, in turn, 
implies (B). Then, both for the no-intercept and unknown intercept versions of 
model ([T]), from the (a) and (b) parts of Theorem^ with j = 1, respective LSA 
1 — 7 CPs for P are 

[Bl{n,z^/2),Bl{n,z^/2)] , k = 1 and 2, (16) 

where for I — 1 and 2, 

/.(n)(^x,~/i)^A»-^^/2E(^^..-gf)(^..,-gr)+(-i)V ^'^T"^ - 

_ 1=1 

n ' 

fk{n){S^y-nY-z^^l^'^{si^^y-giyf 

i=l 

(17) 

with 

fi{n) = n{n - 1), /2(n) = .gf'^ = S'^y, = A6', gif'' = S^y, g^^ = n 

(18) 

and 

2 



2^/2) = 4,zJ^/2fk{n){S^y - l^fYl {j-^^'VV ~ df) ~ dln{Si,xy " ff^)) 

i=l 

Cn n / ^ \ 

^{S,,yy- 9VfY^{Si,xy- Qk'f -{ Y^{Sz,yy- gr){Si.xy- 9^) 
2=1 i=l ' 

(19) 

Individual and, in case of the CPs for /3, also comparative performances of the 
obtained CI's in ([M]) . (fTS]) . and (fTB]) . together with its corresponding analogues 
in terms of /32n, are to be further investigated, and is a subject of the author's 
ongoing research. 

Remark 9. Further to our discussions in Remark [7] on the reliability ratio k^ 
defined in ([13]), we note that this coefficient k^ has also played a key role in the 
literature so far in determining reasonably accurate LSA CI's for /3 and a in 
SEIVM's (P). In particular, habilities that some of LSA CI's for /3 in SEIVM's 
((!]) under Var^ < 00 may sufi'er due to the so-called Gleser- Hwang effect (cf. 
Gleser and Hwang p987p ) are reasonably negligible in SEIVM's if the reliability 
ratio k^ [k^ < 1) is far enough from zero (cf. Gleser (|1987p for details). Though 
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Gleser ()1987p only deals with a specific LSA CI for f3, assuming in this regard 
that the ratio of the uncorrelated variances is known, the just mentioned main 
conclusion is likely to be true for other available LSA CI's for /3, and those for 
a in the SEIVM when Var^ < oo. In particular, it is desirable to rigorously 
support a reasonable belief that big enough fc^ will lead to accurate enough CI's 
in (fT4|) -(fT6 |) . as well as in the analogues of (fT6|) in terms of /32n, in the sense of 
having a negligible Gleser- Hwang effect. A common sense behind Gleser (|1987p 
is that if fc^ — 0, then Varf = and SEIVM (jT]) becomes degenerate, i.e., ([T]) 
reduces to j/i = E ^ (3-\-a-\-di and Xi — E ^ + ei, where the explanatory variables 
do not vary any more, and thus it becomes impossible to fit a unique straight 
line through the data points. As opposed to the latter degenerate model, in 
SEIVM's ^ under Var^ — oo, the explanatory variables are so well spread 
that they dominate the error terms in the sense that, according to our extended 
definition of in Remark [71 fcj :— 1. Hence, it is only natural to conjecture 
that the Gleser-Hwang effect in regards of LSA CI's for f3 and a disappears for 
such SEIVM's that in Remark [7] were seen to behave as if they were like the 
simple regression yi — Xif3 + a + 5i. 

3. Proofs of main results 
3.1. Some auxiliary results 

In this subsection we state some well-known results on DAN as Lemmas [THU 
give a simple alternative proof in the context of this paper for the first part 
of Lemma 0] on a characterization of DAN, and also establish a companion 
characterization as Lemma [5l Further developments in Section 13.21 leading to 
the proofs of the main results of Section [5] are based on these lemmas. 

Hereafter, abbreviation WLLN stands for the Kolmogorov weak law of large 
numbers. 

One of the several necessary and sufficient conditions for {Z, Zi^ i > 1} to be 
in DAN is commonly associated with O'Brien (|1980p as, e.g., in Cine, Gotze and 
Mason (|1997p (for more details see also Remark (iii) in Mailer (|1993p . p. 194), 
and it reads as follows. 

Lemma 1. For i.i.d.r.v. 's {Z, Zi, i > 1}, Z G DAN if and only i/maxi<i<„ Zf j 

The following result was rediscovered by Mailer (|198ip . and is essentially a 
variation of Theorems 4 and 5 on pp. 143-144 in Gnedenko and Kolmogorov 

(HHMi). 

Lemma 2. Let {Z, Zi, i > 1} be i.i.d.r.v. 's inDAN. Then, as n oo, Y^^^j^{Zi — 
E Z)^b~^ -5- 1, where &„ is a positive sequence of numbers such that 'Y^^=i{Zi — 
EZ)b-'^NiO,l). 

The Gine, Gotze and Mason (|1997p fundamental characterization of DAN via 
Studentized or self-normalized partial sums can be stated as follows. 
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Lemma 3. Let {Z,Zi, i > 1} be i.i.d.r.v.'s. Then, conditions Z G DAN and 
E Z ^ a are equivalent to any one of the following CLT's; ^/n{Z — a) (X]"=i('^j~ 



as n —> oo. 

The first part of the foUowing Lemma [4] that is due to Mailer (|198ip says 
that the DAN class of r.v.'s is closed under multiplication operation. Its second 
part amounts to a converse. Lemma |4] is applied in Mailer p98ip to prove the 
asymptotic normality of the regression coefficient in a linear regression when the 
error variance is not necessarily finite. The proof of Lemma|4]in Mailer p98ip is 
quite technical, and is based on checking the classical conditions of Theorem 2 
on p. 128 in Gnedenko and Kolmogorov (|1954p guaranteeing similar convergence 
in distribution to that in (B) for suitably chosen constants 6„. In the present 
context, we present a new, simpler and shorter proof of the first part of Lemma 
|4] under additionally assuming for V e DAN therein that E^F" < oo. The latter 
assumption rhymes with our conditions E 5^ < oo and E'e'* < oo in (A), while 
assumption t/ G DAN of the first part of Lemma |4] coincides with our condition 
(B) for ^. The converse part of Lemma |4] is stated below without a proof. 

Lemma 4. Let {{U,V), {Ui,Vi), i > 1} be i.i.d. random vectors, and U and V 
be independent. If U e DAN and V G DAN, then UV <E DAN. Conversely, if 
EV^ <oo and UV G DAN, then U G DAN. 

Proof. . Wc prove here only the first part of Lemma IH assuming additionally 
to F G DAN that EV^ <oo. 

li EU^ < oo, then, since U and V are independent and nondegenerate (both 
are in DAN), we have YavUV = EU'^EV'^ - {EUf{EVf > 0. Thus, on 
account of the CLT, UV G DAN. 

Suppose now that EU^ = oo. 

First, without loss of generality, we assume that EV^ = 1 and prove the 
following key observation: 



Since U G DAN , then U - EU € DAN and, combining Lemma 3 and (3.7) of 
Gine, Gotze and Mason p997D . one of the key results of that paper, we have 



(i) j:ti(Ur-EU)'V,'/j:tiiUr~EUr^l, n^oo 




For any e > 0, on account of independence of U and V, and (ii). 




2 



i=l 
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i.e., we have (i). 

Furthermore, without loss of generality, we can assume that EU = 0, since 
when EU ^ 0, it is easy to see that 

(iii) {U -E U)V e DAN implies UV £ DAN . 

Indeed, if {U ~ E U)V G DAN , then Lemma El (i) and the fact that EU^ =oo 
yield, as n oo, 

where the slowly varying function £{n) y cx3 is such that {\/n£{n))~^'^^^^{Ui 
-EU) 5. N{0, 1). Also, since < VarF < oo, 

J:7=,{V^-EV)EU V 

(v) — , >A'(0,1), n ^ oo. 

^nVary (£;[/) 2 

Hence, on account of (iv) and (v), with £{n) from (iv), as n — > oo, 

Ei=liUiy^-EU■EV) ^ EtliU^-EU)V^ ^ TJUiy^-EV)EU 
y/nl{n) ^Jnl{n) ^Jnl{n) 

^iV(0,l), 

i.e., UV e DAN via (iii) with EU ^ Q and EU'^ = oo. 

Continuing the proof when EU = and EU^ = oo, hy Lemma [TJ one needs 
to verify that 

n 

max UfV^ I V UfVl = op(l), as n ^ oo, 

i^l 

or, on account of (i), that 

max t/f / V C/f - op (1) , as n ^ oo. 

i=l 

The latter, in turn, easily follows from Markov's inequality, independence of U 
and V and (ii), as follows: for every e > 0, 

P max UM/ Yyf>^<nP {ulV^ / > ^ 

<e-'nE(ul/j2uf^ EV^ ^ o{l). 

□ 
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Remark 10. Further to Lemma HI from Remark on p. 183 in Mailer (|198ip 
we learn that if J7 G DAN, V G DAN and EV^ < oo, then J27=iiUt - 

EU)V,(VnEV^£{n)'^ ^ iV(0, 1) and ^"^^(L/^-i; [/) ~ ^ N{0,1), 

n — !■ oo, with the same slowly varying function at infinity £{n), where, mutatis 
mutandis, £{n) is as in Remark[Tl i.e., accordingly featured for {U, Ui, i > 1}. A 
simple proof of this fact under additionally assuming that EV'^ < oo amounts 
to (iv), where EV^ — 1. 

The results of Lemma |4] will usually be coupled with those of the next one. 

Lemma 5. Let {{U,V), {Ui,Vi), i > 1} be i.i.d. random vectors with E\UV\ < 

00. 

(a) IfU e DAN and V G DAN, then U + V e DAN, provided that P{U + V = 
const) 7^ 1. 

(b) Conversely, if U + V e DAN, U G DAN and EU^ <oo, then V G DAN, 
provided that P{V — const) ^ 1. 

Prooj. (a) \i EU"^ < oo, EV'^ < oo and P(C/ + y = const) ^ 1, then < 
Var ([/ + V) < oo and, due to CLT, [/ + V" G DAN . 

Assume now that, say, E = oo. Then, on account of Lemma[Tl Lemma[2]for 
{U, Ui, i > 1} with bn = y/n£{n), where the slowly varying function £{n) /" oo 
(cf. Remark [1] in terms of {[/, [/,;, i > 1}), and also the WLLN for {UiVi, i > 1} 
with finite mean, 

maxi<;<n(t/i + Vj)'^ ^ maxi<j<n 2{Uf + V^) 

EtAu^ + V.)' - c/f (i + 2ELi u.vjj-^, uf) + V 

2maxi<j<n£/f 2maxi<j<„y/ _ 

Via Lemma [U this proves that [/ + V" G DAN . 

(b) Since EU^ < oo and also E\UV\ < oo, then E\{U + V){-U)\ < oo, 
and via applying the (a) part of Lemma[5]to U + V and —U, we conclude that 
V G DAN . □ 



3.2. Auxiliary results and proofs of main results 

In the sequel, all vectors are row-vectors, and (•,•) stands for Euclidean inner 
product of two vectors. If Z is a d— dimensional vector, then Z^-^^ is its j*'^ 
component, while = zC^+i), • • • , is a subvector of Z that 

has all the components of Z starting with Z'*^) and ending with Z^'^^'^ 1 < < 
d-l, 1<1 <k + l <d, d>2. 

The proofs of the main results of Section [2] require some auxiliary results. 
First, in Lemmas IH] and [71 and Corollary [21 we will study Studentized and self- 
normalized partial sums that are based on i.i.d.r.v.'s {{Ci, b), 1 < i < n}, where 
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6 G H'' is a nonzero vector of constants and 



l<i<n, 

(20) 



with constant c as in ^ and m := E ^. Such sums are the respective prototypes 
of the Studentized and self-normaHzed /3j„ as in (a) and (b) of Theorem [1] in 
the no-intercept version of model (HJ, J — 1 and 2. In ([1]) with an unknown 
intercept, the Studentized and self-normahzed partial sums that are based on 
{('7i('T-), d),l < i < n} play the same role, where 

Viin) = iUi - a, Xi, Si^yy - X0, Si^xy - Si^^cx - 0), (21) 
and a nonzero vector of constants d e is such that 

+ = and d(3)^2 ^ ^(4)^ ^ ^(5) ^ ^22) 

The results in Lemma[8]and Corollary [3] for such partial sums will also be applied 
to derive (jlip of Theorem [2] and Theorem [3] for aj„, j = 1 and 2. Moreover, 
the use of all the auxiliary results in this section can go beyond the immediate 
needs of this paper (cf. Remark [TT|l. At the end of this subsection, we also prove 
Corollary [T] and obtain the CI's of Theorem 01 
Introduce vector 

Co = ((^ - cm)(5, (^ - cm)e, S, e, de - /i, (5^ - Xe, -9^. (23) 

Lemma 6. Assume (A)-(C). When b'-^^ = 6(2) = q, assume additionally that 

Var(Co,6)>0. (24) 

Then, as n oo, 



iV(0, 1) and ^ N{0, 1) 



1/2 ; 1/2 

(25) 



(e:=i(c.-c,^)V("-i)) (Er=i(c.,fe>^) 



Proof. By Lemma |3l ([SS]) is valid if 

(Co,6)eDAN (26) 

and i? (Co, h) = 0. The latter equality follows from (A)— (C). Hence, p6p needs 
to be shown. 

If 6(1) = 6(2) = 0, then, since holds true, we have < Var(Co,6) < oo, 
and thus (|26|) as well. 

Suppose now that |6(i'| + |6(2)| > 0. Then, on account of the first part of 
Lemma H] and the fact that ^ e DAN if and only if ^ — c to e DAN , 

(C - cm)(6(i)5 + 6(2)e) e DAN , (27) 
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(28) 



If Var((Co, b) - (^ - cm)(6(i)(5 + b^^hfj = 0, then ^ imphes Otherwise, 
26|) is imphed by part (a) of Lemma [5] apphcd to (^ — cm){b'-^^6 + fe'-^-'e) and 



((0,^*) - (e-cm)(6(i),5 + 6(2)e) that are now both from DAN. Two conditions 
of (a) of Lemma [5] are left to be verified. First, from the finiteness of i?^ and 
the fourth error moments, and independence of ^ and (5, e), it is seen that 



E 



(e - cm){b^^^6 + b^^^e)[{Co,b) - (^ - c?7i){b^^^S + b^^'>e) 

b^^'^s'' - xe) + b^'He^ 



E 



(6(3)5 + 6We + 6(5) (&_^) 



< oo. 



(29) 



If Var ^ = oo, then the second assumption of the (a) part of Lemma[5l i.e., that 
P{{Coib) = 0) ^ 1, is automaticaUy satisfied, since from |6(i)| + |6(2)| > 0, it 
follows that Var {Co,b) = oo. 

It is left to be shown that Var(Co,fe) > under assuming Var^ < oo and 
|6("'^)| + |6(^^| > 0. Consider the covariance matrix 



Gov Co = 



/ a^\9 a^fi d^\9 d^ii d^m2i d^m^o d^mi2 \ 

a^/i a^O d^/i d^^O d^mi2 d^m2i d^iriQ^ 

d^X9 d^fi X9 II TO21 r7i3o mi2 

d^fi d^9 9 mi2 TO2i 

d^m2i d^mi2 m2i mi2 m22 - - X9ii TO13 - 9pL 

d^m3o d^m2i mso W21 TO31 - \9ii m4o - (A6')^ m22 - \9'^ 

\ d^mi2 d^mos rni2 ruos TO13 - 9ii 77122 - mo4 - 9"^ J 



,(30) 



where 
Let 



d^=E{^~cm) and rriij ^ E{S'e^), < ij < 4. 

I . In . - d\ \ 



A 



\ 



d\ d^ 

1 
1/ 



(31) 



and denote the transpose of matrix A. By performing a straightforward 
multiplication, it can be verified that pO]) is the product of three 7x7 block 
diagonal matrices, namely. 



Gov Co 



A O 
0/3 



O 



O GovCi' 



(3.7) 



(A^^ O 
^0/3 



BCB^ 



(32) 
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where O is a zero matrix of an appropriate size, /a is a 3 x 3 identity matrix 
and r is as in ©. Since Varf > (C e DAN), fo^^'^) ^ q {\b^^'> \ + \b^^'> \ > 0) and 
r is positive definite by (A), then, on using (|32p . we conclude that 

Var(Co,&> = (&CovCo,6> = {{hB)C,bB) 

= ((6i?)(i-2)r, (&i?)(i.2)) + ((6i?)(3.7)CovC^^''\ (6B)(3^7)) 
> ((&B)(i'2)r,(6B)(i'2)) = (a5-d|)(6(i'2)p^^(i,2)^ 

□ 

Corollary 2. j4ssume (A)-(C), and, when b'-^^ = b^^) ^ q, a/so ([21. T/iera, 
as n ^ oo, 

— i/ Var ^ < c» and/or 6(1) = 6(2) = 0, 



(c^'> = <;„ . (33) 

^p^Op(l), z/Vare = oo and |6(i)| + |6(2)| > 0, 

where £^{n) is a slowly varying function at infinity as in Remark^ 

Proof If Var^ < oo and/or 6(i) = 6(2) = 0, then WLLN, ^ and positivity of 
Var(Co, b) under Var^ < oo and |6(i)| + |6(2)| > 0, which is shown in the last 
paragraph of the proof of Lemma [6l result in 

1 " _ 

r V(0-C,&)'^Var(Co,6) >0, n oo, (34) 

n — I ^—^ 



that combined with the first CLT in 1^ yields (C, 6) = Op(1)/V^. 

IfVar^ = oo and |6(i) | + 16(2) | > 0, then Remark[Tn](J7 = ^, V" = 6(i)j+6(2)e), 
([28)1 . Remark [1] and Lemma [2] imply 

nl:|(n) 

where ^^(?^) oo. It can be shown that the latter convergence implies the con- 
vergence in probability of Lite - cm)2(6(i)(5i + 6(2)ei)2/|^n^|(7i)^, ^"^^ (^{^^ 

-cm)(6(i)<5,+6(2)£,)-(e-cm)(6(i)<5 + 6(2)e))'/(^^|W) and Er=i(C.-C, ^')V 
(^^(n)). 



all to the same limit as above. From the first CLT in (1251) and 



{n-l)e{n) 



Var(6(i)5 + 6(2)£) > 0, n ^ oo, (35) 



we have (C,6) — i^{n)Op{l)/^/n, where £^{n)/y/n 0, since £^{n) is slowly 
varying at infinity. □ 
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Next, we conclude that condition ^ e DAN (cf. (B)) is optimal for any one 
of the CLT's in ^ when \b^^^ + |6(2)| > q, i.e., when the Studentized and 
self- normalized partial sums in ((25l) are indeed based on {^i, i > 1}, as opposed 
to the case 6^^^ = &(^) = 0, when they are error-based only. 

Lemma 7. Assume that for i.i.d.r.v.'s {CCii* ^ l}i ^1^1 < (-^) '^'^^ 

(C) hold true, and for vector b G TR\ -I- \b^'^^ > 0. Then, ^ e DAN is 

equivalent to any one of the following CLT's.' ^/n (C, b) (X]"=i(Ci ~ C> ^)^/("- ^ 
1)) ^ iV(0, 1), or n ^( Er=i (0, fe>') ^ ^(0, l),asn^^. 

Proof. According to Lemma [31 any one of the above CLT's is equivalent to (I26p 
and E (Co, b) = 0. Due to the proof of Lemma [6l we only need to show that (I26p 
implies that £, e DAN . 

If Var(^(Co, fo) - - cm)(6(i)(5 -f b^'^'>e)j = 0, then ((261) immediately implies 

([TT)) . Otherwise, (|27p follows from the (b) part of Lemma [5] applied to U + V ^ 
{Co,b) and U — {Co,b) — — cm)(6(^)(5 -I- fo^^^e). Assumptions of this lemma 
are easily seen to be satisfied. We have i?|J7y| < oo on account of and 

U + V e DAN by ((26]) . Clearly, EU^ = E(b'^^^d + b'^^^e + b^''''>{6e - ^l) + b'^'^^S^ - 
A0) -1-6^''^ {e^~9)] < oo, due to (A). Finally, we are to verify that for F = (^ — 

cm)(6(i)(5-H6(^)e), P(^y 0^ 7^ 1. The latter holds true since by Remark[T]and 

gSil that is due to having \b^^^\ + \b^^^ > 0, Var V" > Var^Var(5(i)(5 + 5(2)£) > 0. 
Thus, we have checked conditions of the (b) part of Lemma [5] for obtaining 
(f27l) . Now, from ([27]) . (A) and the converse part of Lemma [4] we conclude that 
erne DAN and hence, £, e DAN . □ 

Proof of Theorem [H The proof is due to Lemma [7] and the following represen- 
tations: 



and u^{j,n) ^ {Ci,bj), 



nU (j, n)(/5j„ - P) _ riu{j,n) 



(36) 

for j = 1 and 2, with 61 = (/3, -/32, 0, 0, -/3, 1, 0) and ^2 = (1, -/3, 0, 0, 1, 0, -/3) 
(6f'^^0). □ 

Lemma 8. Assume (A) -(C) ami p2|) /or a nonzero vector of constants d € 
e = (2/3d(3) , /3rf(4) + 2d(5) , , , d(4) ^ rf(3) ^ ^(5) ) ^ (37) 
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When e(i) = e'^) = 0, assume additionally p4|) . with e in place of b. Then, as 
n — > cxD, 



/n {ri[n), d) 



V 



1/2 



A^(0, 1) and 



n{ri{n),d) v j^^^ (38) 



1/2 



Proo/. On account of 
Mn), d) = d(i)(C,/3 + (5,)+d(2He» +e.)+rf^'^(s^«/3' + 2s,,55/3+ (s»,A-A--A0) 

= (2/3d(3) + d(4))(e, - cO(5. - c^) + (/3d(4) + 2d(5))(^^ _ cO(e^ - ce) 
+d'^^^S^ + rf(2)e, + ((5, - c^)(e, - ce) - a*) 

((5, - c^f - xe^ + ((£, - c£)2 - 

^{C^,e)+cR,{n), (39) 
where vectors Ci and e are as in ([20| and ([37|) . c is from (l6|) and term Ri{n) is 

i?,(n) = e(i) ( - J(e^ - m) + (m - l){5, - J)) 

+e('^ ( - e(6 - m) + (m - ^(e^ - e)) + e'^' ( - £(5. - ^e, + ~5e) 
+e(6)(-2^(5, + (?)2) +e(7)(-2ee, + (e)2). (40) 

If intercept a is known to be zero, i.e., c = 0, then the Studentized and 
self-normalized partial sums in (|25p with vector e in place of 6, and respectively 
those in ([55]) coincide in view of ([55]) . Therefore, the CLT's of Lemma [5] amount 
to those of Lemma |6l 

Suppose now that a is unknown, i.e., c ~ 1. First, we will show that 



y/nR{n) ^ op(l) , if Var^ < oo and/or e'^^ = e^^^ = 0, 

= op{l) , if Vare = oo and |e(i)| + |e(2)| > Q, (41) 

km 

with slowly varying function at infinity £^{n) as in Remark[TJ For the summands 
in 

V^Rinj = V^(e(i)^(m - + e'-^^im - O-e^'^^e - e^^^ (Sf - e^^^ (e)') , (42) 
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from the CLT for 6, (B) and Remark [U as n — > oo, we conclude 
^5(^-m) Op{l)^(^-m) Op(l) 



and, similarly, 



op(l) (43) 



= op(l), V^2Se = op(l), = op(l), = op(l). 



(44) 

This proves ((4T|) that, combined with ((34)) and ((35l) . yields 



^^("^ -op(l). (45) 



(Er=i(0-C,e)V(^-l)) 



1/2 



Now, in view of the first CLT in (|25p of Lemma El ([5^ and , to complete 
the proof of the Studentized CLT in ([38| . it suffices to show that, as n — > oo, 



p 



1, (46) 



Er=i(0-C,e)2 
where 

(C. - C, e) = e(i) ((6 - m)5, - (^ - m)^) + pJ^) ((e, - m)e, - (^ - m)e) 

+e(3) (5, - 5) + e(4) (e, -e) + e^^) (5,£, - fe) + e^^) {5j + e^''> {e\ - F), 

(47) 

and, as a consequence of (|39l) . 

(7y,(n) - d) = e(i) ((e. - ?)(<5,; - ^) - (P - V>)) 
+e'^'■\{i^-l){e,-e)-(^e-le)) 

+e(3) (^, - ^) + e(4) (e^ _ e) + eJ^) ((J, - ^)(e, - e) - (fc - ^e)) 

+ e(6) ((5, - J)2 - (F - (bf)) + e(^) ((£,; - ef - - {ef)) . (48) 

By ([34]) . (fSS]) and the Cauchy-Schwarz inequality, to show (|46|) . it suffices to 
prove that 

-I] ((??»(") -^,rf)-(C.-C,e)) =op(l), (49) 
1=1 

On using the Cauchy-Schwarz inequality again, (|49p follows from the following 
statements for the corresponding summands in (|47p and (|48p : as n — > oo, 

^E(eW((C,-^)(<5,-^)-(p-p))-eW((6-m)<5,-(e-m)<5)j = op(f), 

(50) 
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^ E (^^'^ (te - ((6 - m)e) ^ = op(l), 



1 2 

-^(e(5)((<5,-5)(e,-£)-(fe-Je))-e('^)(,5.£,-fc)) = op(l), (52) 

2—1 

H 2 

- E (^^^'^ ((-^^ - - - (^)')) - ^^'^ (-^^ - ^)) = (53) 



n . 

z— 1 



and 



1 2 

i E (^''^ ((^^ - - - (^)')) - ^^'^ - ^)) - (54) 
Similarly, ([50|l holds true on account of having 

1 " 2 

-E((^''-?)('^^-^)~(^^-™)^^) 
1=1 

= -E(-(^^-^")^+("^-?)('^»-^); 



n 



9 " 9 " 



n -'^ — ' n 



Op{l)-J2{^^-m)' + op{l)^op{l) 



n 

i=l 



and 



i E (le^- (?^-?^))' - ^^^^^^^^ ^ oAD, 

n ^ — ' V / n 

i=l 



where we have applied WLLN, the CLT for S and the Marcinkiewicz-Zygmund 
law of large numbers for {^i — m)^, where E\{S^i — m)^|^/^ < oo. ([STj) is obtained 
in the same manner. All (|52p - (l54p are handled similarly, and easily result from 
the Cauchy-Schwarz inequality and the WLLN under (A). This completes the 
proof of (gll), and hence also that of the first CLT in §8^. The latter CLT 
implies that, as n ^ oo, 



n((77(n),d))2 Op(l) 

- = Op(l 



which combined with the Cauchy-Schwarz inequality proves that 



1, n ^ oo. (55) 

The Studentized CLT in ([55]) and ([55)1 lead to the second, self-normalized CLT 
in S. □ 
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Corollary 3. Let all the assumptions of Lemma^be satisfied. Then, as n oo, 

&W|^,.;|e.i,| + |,«|^0. 

<"<">' "'H 0411" ,.;,,„=,.,.o, « 



with slowly varying function at infinity £^{n) as in Remark^ and vector e of 

(EH). 



Proof From ([35]) and (gS]), as n ^ 00, 



2 

const > 0, otherwise. 



n — 1 

(57) 

The first CLT in §^ and (HID resuh in □ 

Remark 11. Lemmas [71 18] and Corollaries [21 [3] are rather versatile and, apart 
from the needs of this paper, can also be applied to establish Studentized 
and self-normalized marginal CLT's for other estimators that are appropriately 
based on the vector (y, x, Syy, S^y, Sxx) in the context of the SEIVM (|T]) (cf., 
e.g., such CLT's for the weighted least squares estimators for j3 and a, and 
for methods of moments estimators for the error variances X9 and 9 proved in 
Martsynyuk ipiM)) ). 

Proof of (a) and (b) of Theorem [l] under the conditions of Theorem [2l In view 
of TheoremlH we only need to argue that (a) and (b) of Theorem[l]also hold true 
in the model ([1]) with an unknown intercept, provided (A)-(C) are assumed. 
This is a consequence of Lemma [H and the representations in (|36p for j — 1 
and 2, where now Ui{j,n) — {r]i{n),dj), with di — (0,0,1,-/3,0) and d2 = 
(0,0,0,1,-/3) that satisfy (|22l) . and with vectors ei and 62 corresponding to e 
as in ([37)1 that are equal to bi and 62 as specified in the proof of Theorem [Tl □ 

Proof of l|lip of Theorem [21 In view of (b) of Theorem [1] that also holds under 
the conditions of Theorem [21 it suffices to show that, for j — 1 and 2, 

We first note that, on using Remark [Hand Lemma [21 

= 0^(1) ^tife'"^)' + op{l) = op(l), (59) 
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with m — and (-^{n) of Remark[Tl since, due to (3.7) in Gine, Gotze and Ma- 
son (jl997p and identical distribution of the r.v.'s (^i — ~ w)^^ , 
1 < i < n, for any e > 0, 

Also, via Remark [U Lemma [5] and WLLN, as n oo, 

Sxx — _ S^^ 2S^s See — _ S^^ 



— m)^ + — m){m, — c^) + (m — c^)^ 



Op(l) 

f op(l) 



■Va^''^^^'^^<°°' (60) 
1, if Var^ — oo. 



Similarly, 



r, I E£^^ — cm? 

^^^^^ J ^^a^''^^^'^<°°' (61) 



1 , if Var ^ = oo . 



By dSSl), Corollary El (case of |e(i)| + |e(2)| > 0), ^ and WLLN, 

Eti(^42,n)-u.(2,n))2 _ Y:^=l{s^... - 0?{P ^ hn? 



-27-7 = Op(l)- 



n 



n] 



- n^lin) + n24(n) + "^^^^ " ^^^^ 

For i = 2, dSgi follows from with u,(2, n) = (ryj(n), da), da = (0, 0, 0, 1, -/3), 
(HID, (HID (case of |e(i)| + le'^)] > 0), ^ and the Cauchy-Schwarz inequahty. 
The proof of ([55]) for j = 1 is similar to the above lines. □ 

Proof of Corollary \^ for /3j„. The proof follows from (j36|l for j — 1 and 2, with 
Uiijjn) — {r]i{n),dj), where di = (0,0,1,-/3,0) and da = (0,0,0,1,-/3), and 
from Corollary [3] (case of |e(i)| + |e(2)| > 0), dHOl) and dH])- □ 

Proof of the (a) part of Theorem [3l Below we consider the case of San only, as 
the respective CLT for Sin can be proved in a similar way. 
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Suppose first that Var^ — M < oo. Then, by CoroUary [3] for u{2,n), ([60|l . 
Remark [T] and WLLN, as ^ oo, 



Vri{a2n - a) = Vn({y - xfi - a) ~ x02n - P)^ 



^{{y-x(3~a)- —u{2,n)+ i—~^—^]u{2,n) 



= yAiv'{2,n) + op{l), (63) 
where m — E ^ and 

711 

v'i{2,n) ^y,~a-l3xi~ —u^{2,n). 

For y^w'(2,n)(^"^i(u^(2,n)-w'(2,n))V(n-l)) ([MD of Lemma [S] holds 

true, since the respective vector d satisfies ([22]) . and e of ([37]) is such that 
|e(i)| + |e(2)| > if TO ^ 0, and if TO = 0, e^^^ = e^^) = with i.e., with 

inequality Var((5 — /?£) > that is satisfied on account of (A). Combining this 
CLT, ^ with ^,{n) = w-(2,n) and we conclude that 

^/^{a2n~a)\Jyv[{2,n)-v'{2,n)f|(n-l)\ ^iV(0,l), n^^. 

Hence, to complete the proof when Var^ < oo, the following convergence has 
to be shown: as n ^ oo, 



Y.UiM'^.n) - v{2,n) f 
Y:LM%n)-v'{2,n)Y 

, 2 

P 



Eili {{Vi-y)-P{xi~x) - ■g^{ui{2,n) - u(2,n))) 



ELi ({y^-v)-P{x,-x) - ^{u,{2,n)~u{2,n))) 
On observing that WLLN, (|5D|) and ([57)1 with ?7i(n) = Ui{2,n) imply 



1. (64) 



_ V 2 

TO a; \ 1 



M 5, 



J^i'i^ii'^^n-) - u{2,n))'^ = op{l), n ^ oo, 



the proof of ([64|1 follows from the Cauchy-Schwarz inequality and (|57p with 
'?»("-) = wK2,n)- 

Assume now that Var^ = oo. As n oo, we are to prove convergence to 
A^(0,1) of 



(Er=i(^.(2,^)-t'(2,n))V(n-l)) 



1/2 
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1/2 



/Ev'i2, n) - ^x{P2n - 13) / Er=i(«K2, n) - «'(2, n) f 



(65) 

where in this case 

«i(2, = J/i - a - I3xi. 
As n ^ oo, by CoroUary[T]for /32n and WLLN, 

V^X02n -P) = - Op(l), (66) 

with £j(n) as in Remark [H while (A) and WLLN give 

1 " 1 " 2 

— ^ ^(z;,'(2, - ^7(2;^)' = ^T. ((y^ ~ y) - - ^)) 

i=l 1=1 
1 " 2 

= ^ ((<5. - ^) - /3(e, - e)) ^ Var(,5 - /Se) > 0. (67) 

1=1 

By dini), the WLLN for x and dST]) for 77i(n) = Mi(2,7i) (case of Var^ = oo, 
|e(i)| + |e(2)| >0), 

and hence, via the Cauchy-Schwarz inequaUty and (p7)) . as n ^ oo, 

Er=i(«»(2,«)-^K2:^)' 



Er=iK(2,«)-«'(2,n))2 

2 

p 



Ej"=i - y)-Pixi - a::)-5-^(ui(2,7i) - u(2,n))) 



1. (68) 



Er=i ((y* - y) - - a;)) 

FinaUy, combining (I65l)-(l68l) and ([38]) of Lemma[8]for V7^w'(2,n)( Er=i(^»(2; 

\-l/2 

— i;'(2,n) )^/(n— 1) ) (respective vector c? is as in (HH), e of ([57]) is such that 

g(i) — e(2) = Q and condition (|24p. i.e., inequality Var((5 — /3e) > 0, is satisfied on 
account of (A)), one concludes convergence to A^(0, 1) for the initial left hand 
side in (163) • □ 



Proof of the (b) part of Theorem [3l In view of (a) of Theorem [3l the proof re- 
duces to establishing convergence 



2 



Er=i(^»(j» ~ vjj^ n)) 



p 



1, n ^ CX3, J = 1 and 2. (69) 
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For j — I and 2, the expressions for Vi{j, n) are similar and hence, (|69|) is shown 
here for j — 2 only. 

As n — > oo, from Corollary [T] for /?2n, ((60)) . and WLLN, 

(70) 

By (HID and 



1 

- ^ ((^y, (2, n) - ^~{2~nj) - {{v, (2, n) - v,{2,n))'^ ' 

i—1 
1 ''^ 

n ^-^ V 



z— 1 



[/(2,n) 



(Mi(2,n) - w(2, n) ) - (mi(2, n)-u(2, n) ' 



2 



< 2(/? - ^2„)'5.. + 2 ( — ^ ) - X^(u,(2, n) - w,(2, n))' 
\U(2,n) J n ^ 



that combined with the Cauchy-Schwarz inequality results in (|69p for j = 2. □ 



Proof of Corollary]^ for dtjn- Results from the (a) part of Theorem[31 
and (|57|) with ?7i(n) = Vi{j, n) that are as in the proof of the (a) part of Theorem 

n □ 

Proof of Theorem ID Below we derive (|16p for k = 1 only that corresponds to 
the Studentized CLT in the (a) part of Theorem [1] with j = \ that, according to 
Theorem [21 also holds true in the SEIVM ([1]) with an unknown intercept. The 
proof for fc = 2 is similar. 
Consider the set 

'^InKP) ■= <P • ^ r < ^7/2 

[ {^^i=i {{'''i^yy ^ ^yy)~ P{^i,xy ~ ^xy)^ 

(71) 

On account of the CLT in the (a) part of Theorem [T] with j = 1, 

P(Ci„(/3)) ^ 1-7, n^oo. (72) 

It is easy to see that 

Ci„(/3) = {/3:gi„(/3,z^/2)<0}, (73) 
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with the quadratic function in (3 

n 



(74) 



whose respective discriminant Di{n, is as in p9p with k = 1. It is crucial to 
define the sign of Di{n, 2^/2) and that of the coefficient of in Qin(/3, -^7/2) in 
order to proceed. On account of £^1^ |*/'^ < 00 and the Marcinkiewicz-Zygmund 
law of large numbers, as n ^ 00, 

ELi £.f/n^^^ ^ that combined with WLLN 
leads to X]r=i ■^i ^^/"-'^^^ 0' then, to 



i=l i=l 

On using ([75]) . (pT|) and Corollary [1] for /3i„, as n ^ 00, 
sign(i:)i(n, z^/2)) 



/ 



sign 



{Sxy fJ-)' 



i.yy '-'yy 



Syy) Pin{s 



i,xy ^xy. 



V 



'7/2 ('^i=i{si,yy ^yyY'Yli=li.^i,xy SxyY 



n-1 



(X]j=l(*i,S/S/ ^yy)i^i,xy Sxy)j 



(75) 



and 



> sign 



{Sxy M) 



V 



2 V^n ,2 
.^i— 1 i,yy Z-^i—l 



^i^xy \ P 



'^^'^ n\/n — 1 nV'T' — 1 



sign n{n ~ l){Sxy - A^)^ ^ ^7/2 X!'^**^^!' ~ '^^^'^^ 



>sign((5„,-M) 



1. 
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Hence, if 

C2n := {sign(I?i(n, z^/2)) = 1} and 

Can := I sign ^n{n - l){S^y - ^if - 2:^/2 " S,^yf^ = l| , (76) 

then, due to the inequalities 

P{C2n) > P{C2n H Cg™) > P(C2„) + P(C3„) " 1, (77) 

we have 

P{C2n n Csn) ^1, n ^ OO. (78) 
Now, we consider the CI for f3 in witli fc = 1, and denote it by 

CnW := {P : i?J(n,z^/2) < /? < B?(n,z^/2)}, (79) 

where Bl{n, z^/2) and -B^ (n, Z7/2) of p7|) are the respective smaher and bigger 
real roots of the quadratic function (5i„(/3, 2^/2) of (j74p whose discriminant and 
coefficient of the quadratic term are positive. By fTS]) . (|73p . (l78t and inequalities 
similar to those in ([77]) . 

p(c„(/3)) = p(ci„(/3)nC2„nC3„)+p(c„(/3)n(C2„nC3„)^) -> 1-7, n^^. 

□ 
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